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1 Introduction 
1.1 Motivation 

Over the last ten years constraint programming emerged as an interesting and 
viable approach to programming. In this approach the programming process is 
limited to a generation of requirements ( "constraints" ) and a solution of these 
requirements by means of general and domain specific methods. The techniques 
useful for finding solutions to sets of constraints were studied for some twenty 
years in the field of Constraint Satisfaction. One of the most important of them 
is constraint propagation, a process of reducing a constraint satisfaction problem 
to another one that is equivalent but "simpler" . 

The algorithms that achieve such a reduction usually aim at reaching some 
"local consistency" , which denotes some property approximating in some loose 
sense "global consistency" , which is the consistency of the whole constraint sat- 
isfaction problem. In fact, most of the notions of local consistency are neither 
implied by nor imply global consistency (for a simple illustration of this state- 
ment see, e.g., Example |ll| in Subsection |3.3| ). 

For some constraint satisfaction problems such an enforcement of local con- 
sistency is already sufficient for finding a solution in an efficient way or for 



determining that none exists. In some other cases this process substantially re- 
duces the size of the search space which makes it possible to solve the original 
problem more efficiently by means of some search algorithm. 

The aim of this paper is to show that the constraint propagation algorithms 
(also called (local) consistency, consistency enforcing, Waltz, filtering or narrow- 
ing algorithms) can be naturally explained by means of chaotic iteration, a basic 
technique used for computing limits of iterations of finite sets of functions that 
originated from numerical analysis (see, e.g., Chazan and Miranker Q) and was 
adapted for computer science needs by Cousot and Cousot 

In our presentation we study chaotic iteration of monotonic and inflationary 
functions on partial orders first. This is done in Section |^. Then, in Section 
[| we show how specific constraint propagation algorithms can be obtained by 
choosing specific functions and specific partial orders. 

This two-step presentation reveals that several constraint propagation al- 
gorithms proposed in the literature are instances of generic chaotic iteration 
algorithms studied here. 

The adopted framework allows us to prove properties of these algorithms in 
a simple, uniform way. This clarifies which properties of the so-called reduction 
functions (also called relaxation rules or narrowing functions) account for cor- 
rectness of these algorithms. For example, it turns out that idempotence is not 
needed here. Further, this framework allows us to separate an analysis of gen- 
eral properties, such as termination and independence of the scheduling strategy, 
from consideration of specific, constraint-related properties, such as equivalence. 
Even the consequences of choosing a queue instead of a set for scheduling pur- 
poses can be already clarified without introducing constraints. 

We also explain how by characterizing a given notion of a local consistency as 
a common fixed point of a finite set of monotonic and inflationary functions we 
can automatically generate an algorithm achieving this notion of consistency by 
"feeding" these functions into a generic chaotic iteration algorithm. By studying 
these functions in separation we can also compare specific constraint propagation 
algorithms. 

A recent work of Monfroy and Rety |22| also shows how this approach makes 
it possible to derive generic distributed constraint propagation algorithms in a 
uniform way. 

Several general presentations of constraint propagation algorithms have been 
published before. In Section [| we explain how our work relates to and generalizes 
the work of others. 

1.2 Preliminaries 

Definition 1. Consider a sequence of domains V :— D\, . . ., D n . 

— By a scheme (on n) we mean a sequence of different elements from [l..n]. 

— We say that C is a constraint (onT>) with scheme ii, . . if C C x • ■ ■ x 
A,- ' 
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— Let s := si,..., s k be a sequence of schemes. We say that a sequence of 
constraints C\, . . ., Ck on T> is an s- sequence if each d is with scheme Sj. 

— By a Constraint Satisfaction Problem (T>;C), in short CSP, we mean a se- 
quence of domains V together with an s-sequence of constraints C on V. We 
call then s the scheme of (D;C). □ 

In principle a constraint can have more than one scheme, for example when all 
domains are equal. This eventuality should not cause any problems in the sequel. 
Given an n-tuplc d := d\, . . ., d n in D\ x • • • x D n and a scheme s :— i\,...,ii 
on n we denote by d[s] the tuple d^, . . .,di t . In particular, for j G [l..n] d[j] is 
the j-th element of d. By a solution to a CSP (V;C), where V := D\, . . .,D n , 
we mean an n-tuple d G D\ x • • • x D ra such that for each constraint C in C with 
scheme s we have d[s] G C. 

Consider now a sequence of schemes si,...,Sfe. By its union, written as 
(si, . . ., Sfe) we mean the scheme obtained from the sequences si, . . ., by re- 
moving from each the elements present in some Sj, where j < i, and by con- 
catenating the resulting sequences. For example, ((3, 7, 2), (4, 3, 7, 5), (3, 5, 8)} = 
(3, 7, 2, 4, 5, 8). Recall that for an si, . . ., s^-sequence of constraints Ci, . . ., Ck 
their join, written as C\ M • • • M Cfe, is defined as the constraint with scheme 
(si, . . ., Sfe) and such that 

d G Ci N • • • M C k iff d[si] G Ci for i G [l..fc]. 

Further, given a constraint C and a subsequence s of its scheme, we denote 
by II S (C) the constraint with scheme s defined by 

n s (C) :={d[s] \ deC}, 

and call it the projection of C on s. In particular, for a constraint C with scheme 
s and an element j of s, ilj(C) = {a | 3d G C a = o![j]}. 

Given a CSP (D;C) we denote by Sol((D;C}) the set of all solutions to it. 
If the domains are clear from the context we drop the reference to D and just 
write Sol(C). The following observation is useful. 

Note 2. Consider a CSP (V; C) with T> := Di, . . .,D n and C := C\, . . ., Ck and 
with scheme s. 

(*) Sol((V;C)) = d M • • • M C k M ieI D i: 

where I := {i G [l..n] | i does not appear in s}. 
(ii) For every s-subsequence C o/C and d <E Sol((T>;C}) we have d[(s)] G Sol(C). 

□ 

Finally, we call two CSP's equivalent if they have the same set of solutions. 
Note that we do not insist that these CSP's have the same sequence of domains 
or the same scheme. 
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2 Chaotic Iterations 

In our study of constraint propagation we proceed in two stages. In this section 
we study chaotic iterations of functions on partial orders. Then in the next 
section we explain how this framework can be readily used to explain constraint 
propagation algorithms. 

2.1 Chaotic Iterations on Simple Domains 

In general, chaotic iterations are defined for functions that are projections on 
individual components of a specific function with several arguments. In our ap- 
proach we study a more elementary situation in which the functions are unrelated 
but satisfy certain properties. We need the following concepts. 

Deflnition3. Consider a set D, an element d E D and a set of functions F := 
{/l, •••,/&} onD. 

— By a run (of the functions /i, • • -,/fe) we mean an infinite sequence of num- 
bers from [l..fc]. 

— A run i\,i2, ■ ■ ■ is called fair if every i G [l..k] appears in it infinitely often. 

— By an iteration of F associated with a run i\, i 2 , ■ ■ ■ and starting with d we 
mean an infinite sequence of values do, d\, . . . defined inductively by 

d := d, 

dj := fi^dj-i). 

When d is the least element of D in some partial order clear from the context, 
we drop the reference to d and talk about an iteration of F. 

— An iteration of F is called chaotic if it is associated with a fair run. □ 

Definition 4. Consider a partial order (D, C ). A function / on D is called 

— inflationary if x C f(x) for all x, 

— monotonia if x C y implies f(x) C f(y) for all x,y, 

— idempotent if f(f(x)) = f(x) for all x. □ 
In what follows we study chaotic iterations on specific partial orders. 

Definition5. We call a partial order (D, C ) an U-po if 

— D contains the least element, denoted by _L, 

— for every increasing sequence 

do E d\ C d<i . . . 
of elements from D, the least upper bound of the set 

{d , di, d 2 , . . .}, 
denoted by |_I^Lo ^™ anc ^ caue d the limit of do, d\, . . ., exists, 
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— for all a, b G D the least upper bound of the set {a, b}, denoted by a U b, 
exists. 

Further, we say that 

— an increasing sequence do E d\ E ^2 • • ■ eventually stabilizes at d if for 
some j > we have di = d for i > j, 

— a partial order satisfies the finite chain property if every increasing sequence 
of its elements eventually stabilizes. □ 

Intuitively, _!_ is an element with the least amount of information and a \—b 
means that b contains more information than a. Clearly, the second condition of 
the definition of U-po is automatically satisfied if D is finite. 

It is also clear that U-po's are closed under the Cartesian product. In the 
applications we shall use specific U-po's built out of sets and their Cartesian 
products. 

Definition 6. Let D be a set. We say that a family T{D) of subsets of D is 
based on D if 

-De T{D), 

— for every decreasing sequence 

Xq D X\ D X2 - ■ ■ 

of elements of T{D) 

— for all X, Y e T(D) we have X n Y e T(D). 

That is, a set T{D) of subsets of D is based on D iff T(D) with the relation 
C defined by 

X C Y iff X D Y 

is an U-po. In this U-po _L = D and X U Y = X n Y. We call (T(D), U) an U-po 
based on D. □ 

The following two examples of families of subsets based on a domain will be 
used in the sequel. 

Example 1. Define 

T{D) := V(D), 

that is F(D) consists of all subsets of D. This family of subsets will be used to 
discuss general constraint propagation algorithms. □ 
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Example 2. Let (D, C ) be a partial order with the C -least element mm, the 
C -greatest clement moi and such that for every two elements a, 6 6 D both 
a U & and a l~I & exists. 

Examples of such partial orders are a linear order with the C -least element 
and the C -greatest element and the set of all subsets of a given set with the 
subset relation. 

Given two elements a, b of D define 

[a, b] := {c | a < c and c < &} 

and call such a set an interval. So for b < a we have [a, 6] = 0, for b = a we have 
[a, 6] = {a} and [min. .max] = D. 

Let now i* 1 be a finite subset of D containing min and max. Define 

T{D) := {[a,b] | a, fee i 7 }, 

that is F{D) consists of all intervals with the bounds in F. Note that T(D) is 
indeed a family of subsets based on D since 

— D = [min. .max], 

— T{D) is finite, so every decreasing sequence of elements of T(D) eventually 
stabilizes, 

— for a,b, c, d £ F we have 

[a, b] n [c,d] = [aUc, fend]. 

Such families of subsets will be used to discuss constraint propagation algo- 
rithms on reals. In these applications D will be the set of real numbers augmented 
with — oo and +oo and F the set of floating point numbers. □ 

The following observation can be easily distilled from a more general result 
due to Cousot and Cousot jllj. To keep the paper self-contained we provide a 
direct proof. 

Theorem 7 (Chaotic Iteration). Consider an U-po (D, C ) and a set of func- 
tions F := {/i, . . ., fk} on D. Suppose that all functions in F are inflationary 
and monotonic. Then the limit of every chaotic iteration of F exists and coin- 
cides with 

oo 

U / T 3, 

where the function f on D is defined by: 

k 

f{x) : □ Mx) 
i=l 

and f | j is an abbreviation for / J (_L), the j-th fold iteration of f started at _L. 
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Proof. First, notice that / is inflationary, so IJ^Lo / T J exists. Fix a chaotic 
iteration do,di, . . . of F associated with a fair run i\, %2, ■ ■ ■■ Since all functions 
fi are inflationary, Ujlo 4i ex ists. The result follows directly from the following 
two claims. 

Claim 1 Vj 3m f | j C rf m . 

Proof. We proceed by induction on j. 

Base, j = 0. As / f = _L = do, the claim is obvious. 

Induction step. Assume that for some j > we have / f j IZ d m for some 
m > 0. Since 

fe 

/ T (i + 1) = /(/ T i) = U T i), 
i=i 

it suffices to prove 

Vi G [l..fc] 3m 4 /;(/ f j) C d mi . (1) 
Indeed, we have then by the fact that □ di+i for Z > 

k k 

LJ/iCf T j) E |_K* - rfm ' 

i=l i=l 

where m' := max{m,i \ i G [1. .£;]}. 

So fix z G [l../c]. By fairness of the considered run ii, £2, . . ., for some > m 
we have i mi = i. Then d mi = fi(d mi —i). Now d m C d mj _x, so by the monotonic- 
ity of /j we have 

T j) E E fi(dm t -l) = d mi . 

This proves (0). □ 
Claim 2 Vra d m C/|m. 

Proof. The proof is by a straightforward induction on m. Indeed, for m = we 
have do = _L = / f 0, so the induction base holds. 

To prove the induction step suppose that for some m > we have d m E / T 
m. For some z G [l..fc] we have d m +i = fi(d m ), so by the monotonicity of / we 
get d m+1 = /i(cU) E f(d m ) E /(/ T m) = / T (m + 1). □ 

□ 

In many situations some chaotic iteration studied in the Chaotic Iteration 
Theorem |^ eventually stabilizes. This is for example the case when (D, C ) 
satisfies the finite chain property. In such cases the limit of every chaotic iteration 
can be characterized in an alternative way. 
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Corollary 8 (Stabilization). Suppose that under the assumptions of the Chaotic 
Iteration Theorem^ some chaotic iteration of F eventually stabilizes. Then every 
chaotic iteration of F eventually stabilizes at the least fixed point of f. 

Proof. It suffices to note that if some chaotic iteration do, d\. . . of F eventually 
stabilizes at some d m then by Claims 1 and 2 / f m = d m , so 

oo 

U / 1 3 = f T m. (2) 

i=o 

Then, again by Claims I and 2, every chaotic iteration of F stabilizes at / f m 
and it is easy to see that by virtue of (||) / f m is the least fixed point of /. □ 

Finally, using the above results we can compare chaotic iterations resulting 
from different sets of functions. 

Corollary 9 (Comparison). Consider an U-po (D, C ) and two set of func- 
tions, F :— {/i, . . ., fk\ and G := {g\, . . -,gi} on D. Suppose that all functions 
in F and G are inflationary and monotonic. Further, assume that for i G [X..k] 
there exist j\, . . ., j m 6 [l.J] such that 

fi(x) Efec.o g Jm (x) for all x. 

Then lim(F) C lim(G) for the uniquely defined limits lim(F) and lim{G) of the 
chaotic iterations of F and G. 

Proof. Straightforward using the Chaotic Iteration Theorem and the fact that 
the functions in G are inflationary. □ 

2.2 Chaotic Iterations on Compound Domains 

Not much more can be deduced about the process of the chaotic iteration unless 
the structure of the domain D is further known. So assume now that U-po 
(D, C ) is the Cartesian product of the U-po's (Di, C i ), for i G [l..n]. In 
what follows we consider a modification of the situation studied in the Chaotic 
Iteration Theorem ^ in which each function fi affects only certain components 
of D. 

Consider the partial orders (Di, C j), for i G [l..n] and a scheme s := 
i\, . . .,ii on n. Then by (D s , C s ) we mean the Cartesian product of the partial 
orders (Z\ , E for j G [l.J]. 

Given a function / on D s we say that / is with scheme s. Instead of defining 
iterations for the case of the functions with schemes, we rather reduce the situ- 
ation to the one studied in the previous subsection. To this end we canonically 
extend each function / on D s to a function / + on D as follows. Suppose that 
s = ii, . . ., it and 

f(d ll ,...,d ll ) = (e' n ,...,e' u ). 
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Let for j 6 [l..n] 



{ 



e'j if j is an element of s, 
dj otherwise. 



Then we set 



/+(*,... 



d n ) ■= (ei, . . .,e„). 



Suppose now that (D, C ) is the Cartesian product of the U-po's (D i} C { ), 
for i £ and F := {/i, • • -,/fe} is a set of functions with schemes that are 

all inflationary and monotonic. Then the following algorithm can be used to 
compute the limit of the chaotic iterations of F + := {/+, . . ., f£}. We say here 
that a function / depends on i if i is an element of its scheme. 

Generic Chaotic Iteration Algorithm (CI) 



d' := d; 
G:=F; 

while G ^ do 

choose g e G; suppose g is with scheme s; 
G := G — \g\: 
d'[s] :=g(d[a]); 
if d[s] y£ d'[s] then 

G := G U {/ e F | / depends on some % in s such that d[i] ^ 

d[s] :=d'[s] 



Obviously, the condition d[s] ^ d'[s] can be omitted here. We retained it to 
keep the form of the algorithm more intuitive. 

The following observation will be useful in the proof of correctness of this 
algorithm. 

Note 10. Consider the partial orders (D i} C i ) ) for i 6 [l-.n], a scheme s on n 
and a function f with scheme s. Then 

(i) f is inflationary iff f + is. 

(ii) f is monotonic iff f + is. □ 

Observe that, in spite of the name of the algorithm, its infinite executions 
do not need to correspond to chaotic iterations. The following example will be 
of use for a number of different purposes. 

Example 3. Consider the set of natural numbers M augmented with to, with the 
order <. In this order k < co for k E N. Next, we consider the following three 
functions on W U {oj}: 



d:= (-L,...,-L); 
v ' 



n times 



fi 



od 
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n + 1 if n is even, 
/i(n) := ^ n if rt is odd, 
uo if n is w, 



!n + 1 if n is odd, 
n if n is even, 
u> if rt is u>, 

/ 3 (n) := w. 

Clearly, the underlying order is an U-po and the functions f\ , fi and fs are all 
inflationary, monotonic and idempotent. Now, there is an infinite execution of 
the CI algorithm that corresponds with the run 1, 2, 1,2,.. .. This execution does 
not correspond to any chaotic iteration of {/i, /2, fz}. □ 

However, when we focus on terminating executions we obtain the following 
result in the proof of which our analysis of chaotic iterations is of help. 

Theorem 11 (CI). 

(i) Every terminating execution of the CI algorithm computes in d the least fixed 
point of the function f on D defined by 

k 

/(*) : U /',' i n - 
i=l 

(ii) If all (Di, \— j), where i £ satisfy the finite chain property, then every 

execution of the CI algorithm terminates. 

Proof. It is simpler to reason about a modified, but equivalent, algorithm in 
which the assignments d'[s] := g(d[s]) and d[s] := d'[s] are respectively replaced 
by d! := g + (d) and d := d! and the test d[s] ^ d'[s] by d ^ d! . 

(i) Note that the formula 

J:=V/ eF-Gf+(d)=d 

is an invariant of the while loop of the modified algorithm. Thus upon its ter- 
mination 

(G = 0) A I 

holds, that is 

VfeFf+(d)=d. 

Consequently, some chaotic iteration of F + eventually stabilizes at d. Hence d is 
the least fixpoint of the function / defined in item (i) because the Stabilization 
Corollary || is applicable here by virtue of Note |l^. 
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(ii) Consider the lexicographic order of the partial orders (D, □) and (A/", <), 
defined on the elements of D x TV by 

(di,ni) <; ex (d 2 ,n 2 ) iff di □ g?2 or (di = d 2 and m < n 2 ). 

We use here the inverse order □ defined by: d\ □ d 2 iff d 2 C di and g?2 7^ c?i ■ 

By Note |lC](i) all functions / 2 + are inflationary, so with each while loop 
iteration of the modified algorithm the pair 

(d, card G) 

strictly decreases in this order <i ex . However, in general the lexicographic order 
(D x A/", <iex) is not well-founded and in fact termination is not guaranteed. 
But assume now additionally that each partial order (D i: □ ^) satisfies the fi- 
nite chain property. Then so does their Cartesian product (D, □ ). This means 
that (D, □) is well-founded and consequently so is (D x A/", <i ex ) which implies 
termination. □ 

When all considered functions fi are also idempotent, we can reverse the 
order of the two assignments to G, that is to put the assignment G := G — {<?} 
after the if-then-fi statement, because after applying an idempotent function 
there is no use in applying it immediately again. Let us denote by CI I the 
algorithm resulting from this movement of the assignment G := G — {g}. 

More specialized versions of the CI and CII algorithms can be obtained by 
representing G as a queue. To this end we use the operation enqueue(F, Q) 
which for a set F and a queue Q enqueues in an arbitrary order all the elements 
of F in Q, denote the empty queue by empty, and the head and the tail of a non- 
empty queue Q respectively by head(Q) and tail(Q). The following algorithm 
is then a counterpart of the CI algorithm. 

Generic Chaotic Iteration Algorithm with a Queue (CIQ) 

rf:= (-L -,-L) ; 

n times 
d! := d; 
Q := empty; 
enqueue(F, Q); 
while Q ^ empty do 

g := head(Q); suppose g is with scheme s; 
Q := tail(Q); 
d'[s] :=g(d{s}); 
if d[s] ^ d'[s] then 

enqueue({/ £ F | / depends on some % in s such that d[i] ^ d'[i]}, Q); 
d[s]:=d'[s] 

fi 

od 
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Denote by CIIQ the modification of the CIQ algorithm that is appropriate for 
the idempotent functions, so the one in which the assignment Q := tail(Q) is 
performed after the if-then-fi statement. 

It is easy to see that the claims of the CI Theorem [ll] also hold for the CII , 
CIQ and CIIQ algorithms. A natural question arises whether for the specialized 
versions CIQ and CIIQ some additional properties can be established. The answer 
is positive. We need an auxiliary notion and a result first. 

Definition 12. Consider a set of functions F :— {/i, . . ., fk] on a domain D. 

— We say that an element i G [l..k] is eventually irrelevant for an iteration 
d , di , . . . of F if 3m > Vj > m fa (dj) = dj . 

— An iteration of F is called semi-chaotic if every i G [l..k] that appears finitely 
often in its run is eventually irrelevant for this iteration. □ 

So every chaotic iteration is semi-chaotic but not conversely. 

Note 13. 

(i) Every semi-chaotic iteration £ corresponds to a chaotic iteration £' with the 

same limit as £ and such that £ eventually stabilizes at some d iff £ does, 
(ii) Every infinite execution of the CIQ (respectively CIIQj algorithm corresponds 
to a semi-chaotic iteration. 



Proof. 

(i) £ can be transformed into the desired chaotic iteration £f by repeating from 
a certain moment on some elements of it. 

(ii) Consider an infinite execution of the CIQ algorithm. Let ii, 12, ■ . ■ be the run 
associated with it and £ := do,di,... the iteration of F + associated with this 
run. 

Consider the set A of the elements of [l..fc] that appear finitely often in the 
run i\, 12, ■ ■ ■■ For some m > we have ij ^ A for j > m. This means by the 
structure of this algorithm that after m iterations of the while loop no function 
fi with i G A is ever present in the queue Q. 

By virtue of the invariant / used in the proof of the CI Theorem [ll] we then 
have f^(dj) = dj for i G A and j > m. This proves that £ is semi-chaotic. 

The proof for the CIIQ algorithm is the same. □ 



Item (i) shows that the results of Subsection 2.1 can be strengthened to 
semi-chaotic iterations. However, the property of being a semi-chaotic iteration 
cannot be determined from the run only. So, for simplicity, we decided to limit 
our exposition to chaotic iterations. Next, it is easy to show that item (ii) cannot 
be strengthened to chaotic iterations. 

We can now prove the desired results. The first one shows that the non- 
determinism present in the CIQ and CIIQ algorithms has no bearing on their 
termination. 
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Theorem 14 (Termination). If some execution of the CIQ (respectively CIIQj 
algorithm terminates, then all executions of the CIQ (respectively CIIQj algorithm 
terminate. 

Proof. We concentrate on the CIQ algorithm. For the CIIQ algorithm the proof 
is the same. 

Consider a terminating execution of the CIQ algorithm. Construct a chaotic 
iteration of F + the initial prefix of which corresponds with this execution. By 
virtue of the invariant / this iteration eventually stabilizes. By the Stabilization 
Corollary ^ 

every chaotic iteration of F + eventually stabilizes. (3) 

Suppose now by contradiction that some execution of the CIQ algorithm does 
not terminate. Let £ be the iteration of F + associated with this execution. By 
the structure of this algorithm 

£ does not eventually stabilize. (4) 

By Note |l3|(ii) £ is a semi-chaotic iteration. Consider a chaotic iteration £' 
of F + that corresponds with £ by virtue of Note |l2 (i). We conclude by (Q) that 
£' does not eventually stabilize. This contradicts (p ) . □ 

So for a given Cartesian product (D, C ) of the U-po's and a finite set F 
of inflationary, monotonic and idempotent functions either all executions of the 
CIQ (respectively CIIQ) algorithm terminate or all of them are infinite. In the 
latter case we can be more specific. 

Theorem 15 (Non-termination). For every infinite execution of the CIQ (re- 
spectively CIIQj algorithm the limit of the corresponding iteration of F exists 
and coincides with 



u 



/ T j, 

3=0 

where f is defined as in the CI Theorem \l~i\(i). 

Proof. Consider an infinite execution of the CIQ algorithm. By Note |l3](ii) it 
corresponds to a semi-chaotic iteration £ of F + . By Note |l3](i) £ corresponds 
to a chaotic iteration of F + with the same limit. The desired conclusion now 
follows by the Chaotic Iteration Theorem |?]. 

The proof for the CIIQ algorithm is the same. □ 



Neither of the above two results holds for the CI and CI I algorithms. Indeed, 
take the U-po (TV U {w},<) and the functions /i,/2,/3 of Example |[ Then 
clearly both infinite and finite executions of the CI and CII algorithms exist. 
We leave to the reader the task of modifying Example || in such a way that for 
both CI and CII algorithms infinite executions exist with different limits of the 
corresponding iterations. 
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3 Constraint Propagation 



Let us return now to the study of CSP's. We show here how the results of the 
previous section can be used to explain the constraint propagation process. 
In general, two basic approaches fall under this name: 

— reduce the constraints while maintaining equivalence; 

— reduce the domains while maintaining equivalence. 



3.1 Constraint Reduction 

In each step of the constraint reduction process one or more constraints are 
replaced by smaller ones. In general, the smaller constraints are not arbitrary. 
For example, when studying linear constraints usually the smaller constraints 
are also linear. 

To model this aspect of constraint reduction we associate with each CSP 
an U-po that consists of the CSP's that can be generated during the constraint 
reduction process. 

Because the domains are assumed to remain unchanged, we can identify each 
CSP with the sequence of its constraints. This leads us to the following notions. 

Consider a CSP V := (V;C U . . .,C k ) . Let for i G [l..k] {T{C t ),D) be an 
U-po based on d. We call the Cartesian product (CO, C ) of (T(Ci), D), with 
i G [!•■&], a constraint U-po associated with V '. 



As in Subsection 2.2, for a scheme s := i\, . . ., ij we denote by (CO s , E s ) 
the Cartesian product of the partial orders (F(Ci-), 3), where j G 

Note that CO s — T(Gi^) x ■ ■ • x JF(Ci,). Because we want now to use con- 
straints in our analysis and constraint are sets of tuples, we identify CO s with 
the set 

{X x x • • • x Xi | XjE HCa) for j G [l.J]}. 

In this way we can write the elements of CO s as Cartesian products X% x- • -xXj, 
so as (specific) sets of Z-tuples, instead of as (X\, . . ., Xi), and similarly with CO. 

Note that C\ x • • • x CV- is the C -least element of CO. Also, note that because 
of the use of the inverse subset order D we have for X\ x • • • x Xi 6 CO s and 
Y x X • • • x Yj e CO s 

Xi x • • • x Xi c s Yi x • • • x Yj iff Xi x • • • x Xi D Y x x • • • x Yj 

(iEXi D Yi for i G [1..Z]), 

(x x x • • • x Xt) u s (Fx x • • • x y,) = x • • • x x t ) n (y x x • • • x y,) 

(= (Xxny) x ■•• x (jr,ny,)). 

This allows us to use from now on the set theoretic counterparts 2 and H of 
C s and U s . Note that for the partial order (CO s , C s ) a function 5 on CO s 
is inflationary iff C 2 5(C) and 5 is monotonic iff it is monotonic w.r.t. the set 
inclusion. 

So far we have introduced an U-po associated with a CSP. Next, we introduce 
functions by means of which chaotic iterations will be generated. 
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Definition 16. Consider a CSP (T>; C\, . . ., Ck) together with a sequence of fam- 
ilies of sets J-{Ci) based on Cj, for i e and a scheme s on fc. By a constraint 
reduction junction with scheme s we mean a function g on CO s such that for all 
C e CO s 

-CD g(C), 

- Sol(C) = Sol(g(C)). □ 



C is here a Cartesian product of some constraints and in the second condition 
we identified it with the sequence of these constraints, and similarly with 5(C). 
The first condition states that g reduces the constraints , where i is an element 
of s, while the second condition states that during this constraint reduction 
process no solution to C is lost. 

Example 4- As a first example of a constraint reduction function take F(C) := 
V(C) for each constraint C and consider the following function g on some CO s : 



g{C x C) := C x C, 

where C — n t (Sol(C,C)) and t is the scheme of C. In other words, C is the 
projection of the set of solutions of (C, C) on the scheme of C. 

To see that g is indeed a constraint reduction function, first note that by 
the definition of Sol we have C C C, so C x C D g(C x C). Next, note that 
for d E Sol(C, C) we have d[t] £ i7 t (5o^(C, C)), so d G Sol(C, C). This implies 
that Sol(C,C) = Sol(g(C,C)). 

Note also that g is monotonic w.r.t. the set inclusion and idempotent. □ 



Example 5. As another example that is of importance for the discussion in Sub- 



section 4.1 consider a CSP {D±, . . .,D n ;C) of binary constraints such that for 
each scheme i,j on n there is exactly one constraint, which we denote by Cij. 
Again put T(C) := V(C) for each constraint C. 

Define now for each scheme k,l,m on n the following function g™ l on CO s , 
where s is the triple corresponding to the positions of the constraints Ck,i, Ck >m 
and Cmj in C: 



5™;(Afc,; x Xf., m x X m j) := (Xk,i H IIf.,i(Xk im ixi X m j)) x Xk, m x X m ^. 

To prove that the functions g T {.\ are constraint reduction functions it suffices 
to note that by simple properties of the X operation and by Note pJ(i) we have 

Xf.,i n iIfe,z(Afe !m X X rn ,i) = JIk,i(Xk t i X Xk,m X X m ,i) 

= IIk,t(Sol(Xk,i, Xk im , X m> i)), 

so these functions are special cases of the functions defined in Example 0. □ 
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Example 6. As a final example consider linear inequalities over integers. Let 
X\,...,x n be different variables ranging over integers, where n > 0. By a linear 
inequality we mean here a formula of the form 

n 

^ ciiXi < b, 

i=l 

where a\, . . ., a n and b are integers. 

In what follows we consider CSP's that consist of finite or countable sets of 
linear inequalities. Each such set determines a subset of A/"™ which we view as a 
single constraint. Call such a subset an INT- LIN set. 

Fix now a constraint C that is an INT-LIN set formed by a finite or countable 
set LI of linear inequalities. Define J-(C) to be the set of INT-LIN sets formed 
by a finite or countable set of linear inequalities extending LI. Clearly, T(C) is 
a family of sets based on C . 

Given now m linear inequalities 

n 

E a 1 Xi <b>, 

i=l 

where j € [l..m], and m nonnegative reals ci, . . ., c m , we construct a new linear 
inequality 

n m m 
i=l j=l j=l 

If for i G [l..n] each coefficient 2j=i c j a l ^ s an integer, then we replace the 
right-hand side by [J2iLi c j& \- 
This yields the inequality 

n m m 
i=l j=l j=l 

that is called a Gomory-Chvdtal cutting plane. 

An addition of a cutting plane to a set of linear inequalities on integers 
maintains equivalence, so it is an example of a constraint reduction function. 

It is well-known that the process of deriving cutting planes does not have 
to stop after one application (see, e.g., Cook, Cunningham, Pulleyblank, and 
Schrijver || Section 6.7]), so this reduction function is non-idempotent. □ 

We now show that when the constraint reduction function discussed in Ex- 
ample ^ is modified by applying it to each argument constraint simultaneously, 
it becomes a constraint reduction function that is in some sense optimal. 

More precisely, assume the notation of Definition [2^ and let s :— 
Define a function p on CO s as follows: 

p(C) := C, 
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where 

C := Ci x x • • • x Ci l , 



C :— C[ x x • • ■ x C it , 

with each C-. := n tj (Sol(C)), where tj is the scheme of C^. 

So p(C) replaces every constraint C in C by the projection of Sol(C) on the 
scheme of C. 

Note 17 (Characterization). Assume the notation of Definition [7^. A func- 
tion g on CO s is a constraint reduction function iff for all C £ GO s 

p(C)C ff (C)CC. 

Proof. Suppose that s := i\, . . We have the following string of equivalences 
for 

g(C) := X h x • • • x X k : 

p(C) C g(C) iff n t] (Sol(C)) C for j € [l.J] iff SoZ(C) C 5oZ(g(C)). 

So p(C) C fl (C) C C iff (5oZ(C) = Sol(ff(C)) and 5 (C) C C). □ 



Take now a CSP V := (T>; C\, . . ., Ck) and a sequence of constraints C' 1 ,...,C' k 
such that C[ C C, for j e [L.fc]. Let V := (V; C[ , . . ., C£>. We say then that V 
is determined by V and C[ x • •• x C' k . Further, we say that V is smaller than 
V' and V is larger than V' . 

Consider now a CSP V := (T>; C\, . . ., Ck) and a constraint reduction function 
g. Suppose that 

g+(C 1 x---xC k ) = C[ x-.-xCt 



where g + is the canonic extension of g to CO defined in Subsection 2J2. We now 
define 

9 (V) := v>r; rl . 

We have the following observation. 

Lemma 18. Consider a CSP V and a constraint reduction function g. Then V 
and g(V) are equivalent. 

Proof. Suppose that s is the scheme of the function g and let C be an element 
of CO s . So C is a Cartesian product of some constraints. As before we identify 
it with the sequence of these constraints. For some sequence of schemes s, C is 
the s-sequence of the constraints of V. 

Let now d be a solution to V. Then by Note |^(ii) we have d[{s)] G Sol(C), 
so by the definition of g also d[(s)] S Sol(g(C)). Hence for every constraint 
C in 3(C) with scheme s' we have d[s'] S C since c?[(s)][s'] = d[s']. So d is a 
solution to g(V). The converse implication holds by the definition of a constraint 
reduction function. □ 
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When dealing with a specific CSP with a constraint U-po associated with 
it we have in general several constraint reduction functions, each defined on a 
possibly different domain. To study the effect of their interaction we can use 
the Chaotic Iteration Theorem Q in conjunction with the above Lemma. After 
translating the relevant notions into set theoretic terms we get the following 
direct consequence of these results. (In this translation CO s corresponds to D s 
and CO to D.) 

Theorem 19 (Constraint Reduction). Consider a CSPV := (V; C\, . . ., Ck) 

with a constraint U-po associated with it. Let F := {gi, . . -,gk}, where each gt 
is a constraint reduction function. Suppose that all functions gi are monotonic 
w.r.t. the set inclusion. Then 

— the limit of every chaotic iteration of F + := {g^ , . . .,gt } exists; 

— this limit coincides with 



f)gi(C\ x ••• xC fc ), 

3=0 

where the function g on CO is defined by: 



9(C) :=fV( C )> 

i=l 

— the CSP determined by V and this limit is equivalent to V . □ 

Informally, this theorem states that the order of the applications of the con- 
straint reduction functions does not matter, as long as none of them is indefinitely 
neglected. Moreover, the CSP corresponding to the limit of such an iteration pro- 
cess of the constraint reduction functions is equivalent to the original one. 

Consider now a CSP V with a constraint U-po associated with it that sat- 
isfies the finite chain property. Then we can use the CI, CII, CIQ and CIIQ 
algorithms to compute the limits of the chaotic iterations considered in the 



above Theorem. We shall explain in Subsection 4.1 how by instantiating these 
algorithms with specific constraint U-po's and constraint reduction functions we 
obtain specific algorithms considered in the literature. 

In each case, by virtue of the CI Theorem [y] and its reformulations for the 
CII, CIQ and CIIQ algorithms, we can conclude that these algorithms compute 
the greatest common fixpoint w.r.t. the set inclusion of the functions from F + . 
Consequently, the CSP determined by V and this limit is the largest CSP that 
is both smaller than V and is a fixpoint of the considered constraint reduction 
functions. 

So the limit of the constraint propagation process could be added to the 
collection of important greatest fixpoints presented in Barwise and Moss B . 
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3.2 Domain Reduction 



In this subsection we study the domain reduction process. First, we associate 
with each CSP an U-po that "focuses" on the domain reduction. 

Consider a CSP V := (A, ...,D n ; C). Let for % G [l..n] (^(A), 2) be an 
U-po based on A- We call the Cartesian product {DO, C ) of (.F(A), 3), with 
i G [l..n] a domain U-po associated with V. 



As in Subsection 2.2, for a scheme s := ii, . . we denote by (DO s , Q s ) 
the Cartesian product of the partial orders (,F(A,)> D), where j £ [l.J]. Then, 
as in the previous subsection, we identify DO s with the set 

{X 1 x---xX l | X,- e ^(A 3 ) for j 6 [l.i]}. 

Next, we introduce functions that reduce domains. These functions are as- 
sociated with constraints. Constraints are arbitrary sets of fc-tuples for some k, 
while the C s order and the U s operation are defined only on Cartesian prod- 
ucts. So to define these functions we use the set theoretic counterparts 3 and l~l 
of □ s and U s which are defined on arbitrary sets. 



Definition 20. Consider a sequence of domains D%, . . ., A together with a se- 
quence of families of sets J-{Di) based on A, for i G and a scheme s on 
n. By a domain reduction function for a constraint C with scheme s we mean a 
function / on DO s such that for all D G DO s 

- DD/(D), 

- CnD = cn/(D). □ 



The first condition states that / reduces the "current" domains associated 
with the constraint C (so no solution to C is "gained" ) , while the second condi- 
tion states that during this domain reduction process no solution to C is "lost" . 
In particular, the second condition implies that if C C D then C C /(D). 

Example 7. As a simple example of a domain reduction functions consider a 
binary constraint C C A x A- Let J"(A) := P(A) wit h i G [1,2] be the 
families of sets based on A and A- 

Define now the projection functions m and TT2 on DO\ : 2 — V(D%) x "P(A) 
as follows: 

7Ti(A x Y") := X' x r, 
where A' = {a G A | 3b G F (a, 6) G C}, and 

tt 2 (A x Y) := X x Y', 

where Y' = {b G Y \ 3a G A (a, b) G C}. It is straightforward to check that 7Ti 
and 7T2 are indeed domain reduction functions. Further, these functions are mono- 
tonic w.r.t. the set inclusion and idempotent. □ 
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Example 8. As another example of a domain reduction function consider an n- 
ary constraint C C D\ X • • • X D n . Let for i E [l..n] the family of sets based on 
A be defined by .F(A) := "P(A). 

Note that DO = V{D\) x • •• x V(D n ). Define now the projection function 
7TC by putting for D G Z?0 



7T C (D) := 77i(C n D) x • • • x 7T n (C n D). 



Recall from Subsection |L2j that A(C n D) = {a | 3d e C n D a = d[i]}. Clearly 
7rc is a domain reduction function for C and is monotonic w.r.t. the set inclusion 
and idempotent. 

Here the scheme of C is 1, . . .,n. Obviously, 7rc can be defined in an analogous 
way for a constraint C with an arbitrary scheme. □ 



So all three domain reduction functions deal with projections, respectively 
on the first, second or all components and can be visualized by means of Figure 
1. 



r 



Fig. 1. Domain reduction functions. 



The following observation provides an equivalent definition of a domain re- 
duction function in terms of the projection function defined in the last example. 

Note 21 (Characterization). Assume the notation of Definition A func- 
tion f on DO s is a domain reduction function for the constraint C iff for all 
D e DO s 

7T C (D)C/(D)CD. 
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Proof. Suppose that s := ii, . . We have the following string of equivalences 
for 

/(D) := .V, ■ • • • x X H : 

7T C (D) c /(D) iff n l3 (CnD)C JQ, for j 6 [1../] iff C n D C /(D). 

So 7T C (D) C /(D) CDiff(CnD = Cn /(D) and /(D) C D). □ 



Intuitively, this observation means that the projection function nc is an 
"optimal" domain reduction function. In general, however, ttc does not need to 
be a domain reduction function, since the sets HiiC fl D) do not have to belong 
to the used families of sets based on the domain Di . The next example provides 
an illustration of such a situation. 

Example 9. Consider an rt-ary constraint C on reals, that is C C TUt. Let 1Z+ := 
TZU {+oo, — oo}, F be a finite subset of 1Z+ containing — oo and +oo and let the 
family T{JZ+) of subsets of 1Z+ be defined as in Example]^. So 

?(K+) = {[a,b] \a,b&F} 

and 

DO = {[ai,6i] x • • • x [a n ,b n ] \ a h bi e F for i e [l..n]}. 
Further, given a subset X of 1Z+ we define 

int(X) := D{Y e T(n+) \ X C Y}. 

So int(X) is the smallest interval with bounds in F that contains X. Clearly, 
int(X) exists for every X. 

Define now the function / on DO by putting for D S DO 

/(D) := int{IIi(C n D)) x • • • x int(II n (C n D)). 

Bcnhamou and Older j^] proved that / is a domain reduction function that is 
monotonic w.r.t. the set inclusion and idempotent. Note that the first property 
is a direct consequence of the Characterization Note □ 

All the domain reduction functions given so far were idempotent. We now 
provide an example of a natural non-idempotent reduction function. 

Example 10. We consider linear equalities over integer interval domains. By a 
linear equality we mean here a formula of the form 

n 

a,%Xi = b, 

i=i 

where a%, . . ., a n and b are integers. 

In turn, by an integer interval we mean an expression of the form 

[a..b] 
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where a and b are integers; [a..b] denotes the set of all integers between a and b, 
including a and b. 

The domain reduction functions for linear equalities over integer intervals 
are simple modifications of the reduction rule introduced in Davis |12|, page 306] 
that dealt with linear constraints over closed intervals of reals. In the case of a 
linear equality 

^ a^i - ^2 a i x i = b 

iePOS ieNEG 

where 

— a,i is a positive integer for i 6 POS U NEG, 

— Xi and Xj Eire different variables for i ^ j and i,j £ POS U NEG, 

— b is an integer, 

such a function is defined as follows (see, e.g., Apt [Q): 

f([l 1 .Mi},...,[l n .M n ]):=([l[.M[},...X-K}) 
where for j 6 POS 

lj := max{lj, py/]), hj :— min(hj, [oij\), 

for j e NEG 

lj := max(lj, [/%]), /ij := min(hj, [5j\), 



and where 



Pj ' — 



J2iePOS-{j} a ihi + J2ieNEG 

dj 

' + SiePOS ~ J2i£NEG-{j} 



(It is worthwhile to mention that this function can be derived by means of cutting 
planes mentioned in Example ||) . 

Fix now some initial integer intervals Ii,...,I n and let for i G [l..n] the 
family of sets T{1% ) consist of all integer subintervals of li . 

The above defined function / is then a domain reduction function defined 
on the Cartesian product of T(I%) for i G [l..n] and is easily seen to be non- 
idempotent. For example, in case of the CSP 

(xe [0..9],yG [1..8] ; 3x - 5y = 4) 



7? 



and 
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a straightforward calculation shows that 



/([0..9],[1..8]) = ([3..9],[1..4]) 

and 

/([3..9],[1..4]) = ([3..8],[1..4]). 

□ 

Take now a CSP V := {D\, . . ., D n ; C) and a sequence of domains D[ , . . ., D' n 
such that D[ C D{ for i E [l..n]. Consider a CSP V obtained from V by replacing 
each domain Di by D\ and by restricting each constraint in C to these new 
domains. We say then that V is determined by V and D[ x • • • x D' n . 

Consider now a CSP V := (D\, . . .,D n ;C) with a domain U-po associated 
with it and a domain reduction function / for a constraint C of C. We now 
define f(V) to be the CSP obtained from V by reducing its domains using the 
function /. 

More precisely, suppose that 

f+(D 1 x ••■ x £>„) = D[ x---xD' n , 



where / + is the canonic extension of / to DO defined in Subsection 2.2. Then 
f(V) is the CSP determined by V and D' x x • • • x D' n . The following observation 
is an analogue of Lemma [l8|. 

Lemma 22. Consider a CSP V and a domain reduction function f. Then V 
and f(V) are equivalent. 

Proof. Suppose that D\, . . ., D n are the domains of V and assume that / is a 
domain reduction function for C with scheme i\, . . By definition / is defined 
on D il x • • ■ x D it . Let 

f(D h x---xD il ) = D' ii x---xD' it . 

Take now a solution d to V. Then d[i\, G C, so by the definition of / 

also d[ii, . . ., ii] G D' ii x • • • x D'- . So d is also a solution to f(V). The converse 
implication holds by the definition of a domain reduction function. □ 



Finally, the following result is an analogue of the Constraint Reduction The- 
orem It is a consequence of Iteration Theorem [7] and the above Lemma, 
obtained by translating the relevant notions into set theoretic terms. (In this 
translation DO s corresponds to D s and DO to D.) 

Theorem 23 (Domain Reduction). Consider a CSP V :— (Di, ...,D n ; C) 
with a domain U-po associated with it. Let F := {/i, . . ., //.}, where each fi is a 
domain reduction function for some constraint in C. Suppose that all functions 
fi are monotonic w.r.t. the set inclusion. Then 

— the limit of every chaotic iteration of F + := {/^ , . . ., fu} exists; 
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— this limit coincides with 

CO 

f) /''(£>i x---xD n ), 
j=o 

where the function f on DO is defined by: 

k 

/(D) :=f|/+(D), 

i=i 

— the CSP determined by V and this limit is equivalent to V. □ 

The above result shows an analogy between the domain reduction functions. 
In fact, the domain reduction functions can be modeled as constraint reduction 
functions in the following way. 

First, given a CSP (Di, . . ., D n ; C) add to it n unary constraints, each of which 
coincides with a different domain Di. This yields V := (£>i, . . -,D n ; C, D\, . . ., D n ). 
Obviously, both CSP's are equivalent. 

Next, associate, as in the previous subsection, with each constraint C of V 
an U-po T(C) based on it. 

Take now a constraint C £ C with a scheme s := ii, . . and a function / 
on DO s - Define a function g on 

T(C) x T(D H ) ■ ■ ■ x T(D H ) 

by 

g(C',r>) := (C',/(D)). 

Then / is a domain reduction function iff g is a constraint reduction function, 
since Sol(C',T>) :=C"nD. 

This simple representation of the domain reduction functions as the con- 
straint reduction functions shows that the latter concept is more general and 
explains the analogy between the results on the constraint reduction functions 
and domain reduction functions. It also allows us to analyze the outcome of "hy- 
brid" chaotic iterations in which both domain reduction functions and constraint 
reduction functions are used. 

We discussed the domain reduction functions separately, because, as we shall 
see in the next section, they have been extensively studied, especially in the 
context of CSP's with binary constraints and of interval arithmetic. 

3.3 Automatic Derivation of Constraint Propagation Algorithms 

We now show how specific provably correct algorithms for achieving a local 
consistency notion can be automatically derived. The idea is that we characterize 
a given local consistency notion as a common fixpoint of a finite set of monotonic, 
inflationary and possibly idempotent functions and then instantiate any of the 
CI , CII , CIQ or CIIQ algorithms with these functions. As it is difficult to define 
local consistency formally, we illustrate the idea on two examples. 
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Example 11. First, consider the notion of arc-consistency for n-ary relations, 
defined in Mohr and Masini [2lJ . We say that a constraint C C D% X • • • X D n 
is arc- consistent if for every i € [l..n] and a € Di there exists d € C such that 
a = d[i]. That is, for every involved domain each element of it participates in a 
solution to C. A CSP is called arc consistent if every constraint of it is. 

For instance, the CSP ({0, 1}, {0, 1}; =, 7^) that consists of two binary con- 
straints, that of equality and inequality over the 0-1 domain, is arc consistent 
(though obviously inconsistent). 

Note that a CSP (Di, . . .,D n ;C) is arc consistent iff for every constraint C 
of it with a scheme s := it, . . .,ii we have TrciD^ x • • • x ) = x • • • x , 
where nc is defined in Example ||. We noted there that the projection functions 
7rc are domain reduction functions that are monotonic w.r.t. the set inclusion 
and idempotent. 

By virtue of the CI Theorem [IT| reformulated for the CII algorithm, we can 
now use the CII algorithm to achieve arc consistency for a CSP with finite 
domains by instantiating the functions of this algorithm with the projection 
functions nc- 

By the Domain Reduction Theorem ^ we conclude that the CSP computed 
by this algorithm is equivalent to the original one and is the greatest arc consis- 
tent CSP that is smaller than the original one. □ 



Example 12. Next, consider the notion of relational consistency proposed in 
Dechter and van Beek |Q. Relational consistency is a very powerful concept 
that generalizes several consistency notions discussed until now. 

To define it we need to introduce some auxiliary concepts first. Consider a 
CSP (Di, . . .,D n ;C). Take a scheme t := it, . . ., i\ on n. We call d G D il x • ■ -xDj, 
a tuple of type t. Further, we say that d is consistent if for every subsequence s 
of t and a constraint C G C with scheme s we have d[s] G C. 

A CSP V is called relationally m-consistent if for any s-sequence C±, . . ., C m 
of different constraints of V and a subsequence t of (s), every consistent tuple 
of type t belongs to n t {C\ M • ■ ■ X C m ), that is, every consistent tuple of type t 
can be extended to an element of Sol(C\, . . ., C m ). 

As the first step we characterize this notion as a common fixed point of a 
finite set of monotonic and inflationary functions. 

Consider a CSP V := (Di, . . -,D n ; Ci, . . ., Ck)- Assume for simplicity that 
for every scheme s on n there is a unique constraint with scheme s. Each CSP 
is trivially equivalent with such a CSP — it suffices to replace for each scheme 
s the set of constraints with scheme s by their intersection and to introduce 
"universal constraints" for the schemes without a constraint. By a "universal 
constraint" we mean here a Cartesian product of some domains. 

Consider now a scheme it, . . .,i m on k. Let s be such that C,^, . . ., Ci m is 
an s-sequence of constraints and let t be a subsequence of (s). Further, let Ci a 
be the constraint of V with scheme t. Put s :— ((io), (h, ■ ■ -,im))- (Note that 
if io does not appear in it, ■ ■ .,i m then s = io, it, ■ ■ ., i m an d otherwise s is the 
permutation of it,.. .,i m obtained by transposing io with the first element.) 
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Define now a function g s on CO s by 

g s (C x C) := (C n iT t (M C)) x C. 

It is easy to see that if for each function g s of the above form we have 

gt(C 1 x---xC k ) = C 1 x---xC k , 

then V is relationally m-consistent. (The converse implication is in general not 
true). Note that the functions g s are inflationary and monotonic w.r.t. the inverse 
subset order D and also idempotent. 

Consequently, again by the CI Theorem [ll] reformulated for the CI I algo- 
rithm, we can use the CI I algorithm to achieve relational m-consistency for 
a CSP with finite domains by "feeding" into this algorithm the above defined 
functions. The obtained algorithm improves upon the (authors' terminology) 
brute force algorithm proposed in Dechter and van Beek @ since the useless 
constraint modifications are avoided. 

As in Example ||, by simple properties of the ixi operation and by Note ||(i) 
we have 

cnn t (M c) = n t (c x (tx c)) = n t (Soi(c,c)). 

Hence, by virtue of Example |J, the functions g s are all constraint reduction 
functions. Consequently, by the Constraint Reduction Theorem |l9| we conclude 
that the CSP computed by the just discussed algorithm is equivalent to the 
original one. □ 



4 Concluding Remarks 
4.1 Related Work 

As already mentioned in the introduction, the idea of chaotic iterations was 
originally used in numerical analysis. The concept goes back to the fifties and 
was successively generalized into the framework of Baudet || on which Cousot 
and Cousot jy] was based. Our notion of chaotic iterations on partial orders is 
derived from the last reference. A historical overview can be found in Cousot 
@. 

Let us turn now to a review of the work on constraint propagation. We show 
how our results provide a uniform framework to explain and generalize the work 
of others. 

It is illuminating to see how the attempts of finding general principles behind 
the constraint propagation algorithms repeatedly reoccur in the literature on 
constraint satisfaction problems spanning the last twenty years. 

As already stated in the introduction, the aim of the constraint propagation 
algorithms is most often to achieve some form of local consistency. As a result 
these algorithms are usually called in the literature "consistency algorithms" or 
"consistency enforcing algorithms" though, as already mentioned, some other 
names are also used. 
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In an early work of Montanari [|23| the notion of path-consistency was defined 
and a constraint propagation algorithm was introduced to achieve it. Then, 
in the context of analysis of polyhedral scenes, another constraint propagation 
algorithm was proposed in Waltz f30| . 

In Mackworth |19| the notion of arc-consistency was introduced and Waltz' 
algorithm was explained in more general terms of CSP's with binary constrains. 
Also, a unified framework was proposed to explain the arc- and path-consis- 
tency algorithms. To this end the arc-consistency algorithm AC-3 and the path- 
consistency algorithm PC-2 were introduced and the latter algorithm was ob- 
tained from the former one by pursuing the analogy between both notions of 
consistency. 

A version of AC-3 consistency algorithm can be obtained by instantiating 
the CI I algorithm with the domain reduction functions defined in Example [?], 
whereas a version of PC-2 algorithm can be obtained by instantiating this algo- 
rithm with the constraint reduction functions defined in Example ^|. 

In Davis jl2j another generalization of Waltz algorithm was proposed that 
dealt with n-ary constraints. The algorithm proposed there can be obtained 
by instantiating the CIQ algorithm with the projection functions of Example [?] 
generalized to n-ary constraints. To obtain a precise match the enqueue oper- 
ation in this algorithm should enqueue the projection functions related to one 
constraint in "blocks" . 

In Dechter and Pearl the notions of arc- and path-consistency were mod- 
ified to directional arc- and path-consistency, versions that take into account 
some total order <d of the domain indices, and the algorithms for achieving 
these forms of consistency were presented. Such algorithms can be obtained as 
instances of the CIQ algorithm as follows. 

For the case of directional arc-consistency the queue in this algorithm should 
be instantiated with the set of the domain reduction functions ~k\ of Example ^ 
for the constraints the scheme of which is consistent with the <d order. These 
functions should be ordered in such a way that the domain reduction functions 
for the constraint with the <d-large second index appear earlier. This order 
has the effect that the first argument of the enqueue operation within the if- 
then-fi statement always consists of domain reduction functions that are already 
in the queue. So this if-then-fi statement can be deleted. Consequently, the 
algorithm can be rewritten as a simple for loop that processes the selected 
domain reduction functions ~n\ in the appropriate order. 

For the case of directional path-consistency the constraint reduction functions 
g™ t should be used only with k,l <d m and the queue in the CIQ algorithm should 
be initialized in such a way that the functions with the <d-large m index 
appear earlier. As in the case of directional arc-consistency this algorithm can 
be rewritten as a simple for loop. 

In Montanari and Rossi |24|] a general study of constraint propagation was 
undertaken by defining the notion of a relaxation rule and by proposing a general 
relaxation algorithm. The notion of a relaxation rule coincides with our notion 
of a constraint propagation function instantiated with the functions defined in 
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Example |] and the general relaxation algorithm is the corresponding instance 
of our CI algorithm. 

In Montanari and Rossi [£4j it was also shown that the notions of arc- 
consistency and path-consistency can be defined by means of relaxation rules 
and that as a result arc-consistency and path-consistency algorithms can be 
obtained by instantiating with these rules their general relaxation algorithm. 

Another, early attempt at providing a general framework to explain con- 
straint propagation was undertaken in Caseau |?]] . In this paper abstract inter- 
pretations and a version of the CIQ algorithm are used to study iterations that 
result from applying approximations of the projection functions of Example ^ 
generalized to n-ary constraints. It seems that for finite domains these approxi- 
mation functions coincide with our concept of domain reduction functions. 

Next, Van Hentenryck, Deville and Teng [^9| presented a generic arc consis- 
tency algorithm, called AC-5, that can be specialized to the known arc-consistency 
algorithms AC-3 and AC-4 and also to new arc-consistency algorithms for specific 
classes of constraints. More recently, this work was extended in Deville, Barette 
and Van Hentenryck to path-consistency algorithms. 

Let us turn now our attention to constraints over reals. In Lhomme [jl8| 
the notion of arc B-consistency was introduced and an algorithm proposed that 
enforces it for constraint satisfaction problems defined on reals. This algorithm 
can be obtained by instantating our CI algorithm with the functions defined in 
Example ^. 

Next, in Benhamou, McAUester, and Van Hentenryck H and Benhamou and 
Older Q specific functions, called narrowing functions, were associated with 
constraints in the context of interval arithmetic for reals and some properties of 
them were established. In our terminology it means that these are idempotent 
and monotonic domain reduction functions. One of such functions is defined in 
Example^. As a consequence, the algorithms proposed in these papers, called re- 
spectively a fixpoint algorithm and a narrowing algorithm, become the instances 
of our CIIQ algorithm and CII algorithm. 

Other two attempts to provide a general setting for constraint propagation 
algorithms can be found in Benhamou Q and Telerman and Ushakov ^7j. In 
these papers instead of U-po's specific families of subsets of the considered do- 
main are taken with the inverse subset order. In Benhamou they are called 
approximate domains and in Telerman and Ushakov |2^| subdefinite models. 
Then specific algorithms are used to compute the outcome of constraint propa- 
gation. The considered families of subsets correspond to our U-po's, the discussed 
functions are in our terminology idempotent and monotonic domain restriction 
functions and the considered algorithms are respectively the instances of our CII 
and CI algorithm. 

In both papers it was noted that the algorithms compute the same value in- 
dependently of the order of the applications of the functions used. In Benhamou 
Q local consistency is defined as the largest fixpoint of such a collection of func- 
tions and it is observed that on finite domains the CII algorithm computes this 
largest fixpoint. In Telerman and Ushakov |27| the subdefinite models are dis- 
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cussed as a general approach to model simulation, imprecise data and constraint 
programming. Also related articles that were published in 80s in Russian are 
there discussed. 

The importance of fairness for the study of constraint propagation was first 
noticed in Gusgen and Hertzberg frTi| where chaotic iterations of monotonic 
domain reduction functions were considered. Results of Sectio n (in view of 
their applications to the domain reduction process in Subsection 3.2) generalize 
the results of this paper to arbitrary U-po's and their Cartesian products. In 
particular, Stabilization Corollary || generalizes the main result of this paper. 

Fairness also plays a prominent role in Montanari and Rossi [24|] , while the 
relevance of the chaotic iteration was independently noticed in Fages, Fowler, 
and Sola (l6) and van Emdcn ||^] . In the latter paper the generic chaotic itera- 
tion algorithm CI I was formulated and proved correct for the domain reduction 
functions defined in Benhamou and Older |j| and it was shown that the limit of 
the constraint propagation process for these functions is their greatest common 
fixpoint. 

The idea that the meaning of a constraint is a function (on a constraint store) 
with some algebraic properties was put forward in Saraswat, Rinard, and Panan- 
gaden |2(| , where the properties of being inflationary (called there extensive) , 
monotonic and idempotent were singled out. 

A number of other constraint propagation algorithms that were proposed 
in the literature, for example, in four out the first five issues of the Constraints 
journal, can be shown to be instances of the generic chaotic iteration algorithms. 

In each of the discussed algorithms a minor optimization can be incorporated 
the purpose of which is to stop the computation as soon as one of the variable 
domains becomes empty. In some of the algorithms discussed above this opti- 
mization is already present. For simplicity we disregarded it in our discussion. 
This modification can be easily incorporated into our generic algorithms by using 
□ -po's with the greatest element T and by enforcing an exit from the while 
loop as soon as one of the components of d becomes T. 



4.2 Idempotence 

In most of the above papers the (often implicitly) considered semantic, con- 
straint or domain reduction functions are idempotent, so we now comment on 
the relevance of this assumption. 

To start with, we exhibited in Example || and ^ natural constraint and 
domain reduction functions that are not idempotent. Secondly, as noticed in 
Older and Vellino ]25| |, another paper on constraints for interval arithmetic on 
reals, we can always replace each non-idempotent inflationary function / by 

oo 

/*(*) : LI-'"-'-*- 

i=i 

The following is now straightforward to check. 
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Note 24. Consider an U-po (D, Q ) and a function f on D. 

— If f is inflationary, then so is /*. 

— If f is monotonic, then so f*. 

— If f is inflationary and (D, C ) has the finite chain property, then f* is 
idempotent. 

— If f is idempotent, then f* = f. 

— Suppose that (D, Q ) has the finite chain property. Let F := {/i, . . ., fk} be 
a set of inflationary, monotonic functions on D and let F* := {/*, . . ., 
Then the limits of all chaotic iterations of F and of F* exist and always 
coincide. □ 

Consequently, under the conditions of the last item, every chaotic iteration 
of F* can be modeled by a chaotic iteration of F, though not conversely. In 
fact, the use of F* instead of F can lead to a more limited number of chaotic 
iterations. This may mean that in some specific algorithms some more efficient 
chaotic iterations of F cannot be realized when using F*. For specific functions, 
for instance those studied in Examples ^ and [Io|, the computation by means of 
F* instead of F imposes a forced delay on the application of other reduction 
functions. 



4.3 Comparing Constraint Propagation Algorithms 

The CI Theorem flT|and its reformulations for the CII , CIQ and CIIQ algorithms 
allow us to establish equivalence between these algorithms. More precisely, these 
result show that in case of termination all four algorithms compute in the variable 
d the same value. 

In specific situations it is natural to consider various domain reduction or 
constraint reduction functions. When the adopted propagation algorithms are 
instances of the generic algorithms here studied, we can use the Comparison 
Corollary ^| to compare their outcomes. By way of example consider two instances 
of the CII algorithm: one in which for some binary constraints the pair of the 
domain reduction functions defined in Example |t] is used, and another in which 
for these binary constraints the domain reduction function defined in Example 
H is used. 

We now prove that in case of termination both algorithms compute in d the 
same value. Fix a binary constraint C and adopt the notation of Example (7] and 
of Example || used with n = 2. Note that for X € DO\ t 2 

- 7T C (X) = 7Tl O 7T 2 (X), 

- 7T;(X) D 7T C (X) for i 6 [1..2]. 

Clearly, both properties hold when each function / G {^c ^1^2} is replaced 
by its canonic extension / + to the Cartesian product DO of all domains V{Di). 
By the Stabilization Corollary U, Comparison Corollary || and the counterpart 
of the CI Theorem [n] for the CIIQ algorithm we conclude that both algorithms 
compute in d the same value. 
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An analogous analysis for arbitrary const rain ts allows us to compare the 
algorithm of Davis [ll| discussed in Subsection 4T with that defined in Example 
11 We can conclude that in case of termination both algorithms achieve arc- 
consistency for n-ary constraints. 



4.4 Assessment and Future Work 

In this paper we showed that several constraint propagation algorithms can be 
explained as simple instances of the chaotic iteration algorithms. Such a generic 
presentation also provides a framework for generating new constraint propaga- 
tion algorithms that can be tailored for specific application domains. Correctness 
of these constraint propagation algorithms does not have to be reproved each 
time anew. 

It is unrealistic, however, to expect that all constraint propagation algorithms 
presented in the literature can be expressed as direct instances of the generic 
algorithms here considered. The reason is that for some specific reduction func- 
tions some additional properties of them can be exploited. 

An example is the perhaps most known algorithm, the AC-3 arc-consistency 
algorithm of Mackworth [[l9| . We found that its correctness relies in a subtle way 
on a commutativity property of the projection functions discussed in Example 
. This can be explained by means of a generic algorithm only once one uses the 
information which function was applied last. 

Another issue is that some algorithms, for example the AC-4 algorithm of 
Mohr and Henderson |^ and the GAC-4 algorithm of Mohr and Masini pl[ |, 
associate with each domain element some information concerning its links with 
the elements of other domains. As a result these algorithms operate on some 
"enhancement" of the original domains. To reason about these algorithms one 
has to relate the original CSP to a CSP defined on the enhanced domains. 

In an article under preparation we plan to discuss the refinements of the 
general framework here presented that allow us to prove correctness of such 
algorithms in a generic way. 
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